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FOREWORD 



This report describes research performed by the Human Resources Research 
Organization as part of a basic research effort (BR-14), The objective of Basic Research 
Study 14, Prompting and Guidance in Training, is to develop effective methods for 
training men to perform simple everyday Army tasks, such as procedures or the obtaining 
of reference information, by applying prompting and guidance techniques in experimental 
training programs. A “prompting” or “guidance” technique is defined as a method of 
training that puts the learner in a realistic work situation and indicates each required 
action, one step at a time, as he performs the task, A report of a study of paired- 
associates (identification) learning, HumRRO Technical Report 70-21, Prompting and 
Guessing in Tank Identification , by Elmo E. Miller was published in December 1970, 

The research was initiated while HumRRO was part of The George Washington 
University. BR 14 research is an outgrowth of HumRRO research performed under Work 
Unit RECON III, Training Methods and Techniques for Improving Combat Readiness of 
the Armored Cavalry Platoon, and SHOCKACTION, Evaluation arid Improvement of 
Individual Training for Tank Crewmen. 

The research was begun and data collected at HumRRO Division No. 2, Fort Knox, 
Kentucky, under the supervision of Dr. Norman Willard, and subsequently of Dr. Donald 
F. Haggard, as Director. Support was provided by the U.S. Army Armor Human Research 
Unit, with LTC William Q. Harty as Chief of the Unit during the conduct of the research 
described in this report; LTC J,A. DeAngelis is the present Unit Chief, Work on the 
research was completed at HumRRO Division No. 5, Fort Bliss, Texas; Dr. Robert D. 
Baldwin was then Director, 

The purpose of the work summarized in this report is to develop effective pictorial 
techniques for instruction on serial (procedural) tasks, (These pictorial techniques were 
also adapted and applied in conducting Technical Advisory Service pertaining to the 
revised Army manual on pistols and revolvers.) The present report is a summary of the 
results of research comparing various techniques for using sound movies and pictorial 
books for instruction on the serial (procedural) tasks. The objective was to determine the 
general characteristics of effective pictorial demonstrations for such tasks, and effective 
ways of using such materials in training. 

HumRRO research is conducted under Army Contract DAHC 19-70-0-0012. Basic 
Research is conducted under Army Project 2Q061102B74B, 



Meredith P. Crawford 
President 

Human Resources Research Organization 




PROBLEM 

In training on a manipulative procedure, such as disassembly or assembly of a 
weapon, it is customary to provide a demonstration of the desired performance in some 
combination with actual practice of the task. If many men are to be trained, it is 
generally most efficient to have the demonstration in some standard, pre-packaged form, 
such as a movie or pictorial book. The research reported here is designed to answer some 
significant questions that arise in the development and use of such demonstration 
programs. 

The issues studied include (a) whether to develop the program empirically through 
tryout and revision, (b) whether to have the trainee practice each step immediately after 
it is demonstrated, (c) whether to give repeated showings of the demonstration, 
(d) whether to use a movie or a book propam, and (e) what principles to follow in 
producing a demonstration film. 




METHOD 

An Army training film, was condensed to include only the segments that actually 
demonstrated disassembly and assembly, A revised version of the film was developed by 
showing it to novices, step by step, as they performed the task, and modifying the 
portions that viewers found difficult. Both the original and the revised films were adapted 
for showing either step by step or as a whole The effect of showing the film twice 
(rather than only once) before practice was also explored. An optional introduction 
incorporating the “implosion 55 technique 1 (as opposed to the standard Army introduction 
of naming the parte) was also prepared. 

These four variables, and all combinations, were compared experimentally in a 
2 x 2 x 2 x 2 factorial design to assess their effects and any interaction of these treat- 
ments (98 subjects in six replications). Another 48 subjects were run with a comparable 
pictorial book propam which had been developed previously. All subjects practiced until 
they achieved one perfect trial without assistance. 



RESULTS 

The data on practice ibue (to the criterion of one unassisted, error-free trial) show 
that mi extra presentation of the film benefited the subjects who then got another 
continuous showing (it seem ad to save about as much practice time as it took to show 
the film), but the extra showing seemed a waste of time for the subjects who received 
the step-by-step presentation. Otherwise all programs seemed to train in roughly the same 
amount of time, if film-showing time is included. 

The data on the number of times the trainees needed assistance show many striking 
contrasts which are especially important in view of the general shortage of instructors. On 
the first trial, the number of assists needed was reduced by the use of the revised film, 
by showing the film step by step, and by an extra showing of the film. (The extra 
presentation, however, seemed to benefit only those subjects who got another continuous 

1 A movie technique in which the parts appear to pop suddenly into place, one at a time, to form the 
completed assembly. 
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showing, but not those who saw a step-by-step presentation; the same pattern was also 
found in the practice time data.) The special imploded introduction did not produce any 
advantage over the standard Army introduction on either the time or assists criterion. 

On subsequent trials, the step-by-step viewing resulted in significantly more assists (a 
reversal of the first trial trends), although the subjects did not fall back to the level of 
first trial performance of subjects who viewed the film continuously. The revised film 
continued to show a significant advantage over the Army film. The extra showing did not 
produce a significant difference in number of assists. 

For subjects who received the book treatment, the number of assists was roughly 
comparable to the average for subjects who saw the Army film, but significantly higher 
than for subjects who saw the revised film. 

The changes made in producing the revised film entail many principles for such 
films, and these principles were organized into a coherent set. 



CONCLUSIONS 

(1) The reliability of communication of a demonstration film may be increased 
appreciably by careful tryouts with novices and subsequent film revision. In a revision, 
the thoroughness that may be warranted will depend on how many trainees are expected, 
and other situational factors, 

(2) When students see a film one step at a time as they perform the task, they 
require fewer assists on the first trial than students who see the film without inter- 
ruption, yet on the second trial they need more assists (as the step-by-step guidance is 
withdrawn) than those who have had no such guidance. There is thus no evidence that 
such guidance (when assistance is available) saves time, and certain factors inherent in the 
guidance method place a limit on how rap’.dly a person can demonstrate mastery, 

(3) The revised film, shown step by step, virtually eliminates the need for assists on 
the first trial. Thereafter, oy appropriate methods of showing the film, assistance may be 
kept to a minimum. 

(4) If the continuous viewing method is chosen in a situation where step-by-step 
viewing is considered especially awkward, an extra showing of the film at the start is 
likely to be worthwhile, in terms of both time and assists. (This is not true for 
step-by-step viewing.) If the film is developed like the revised one in the present program, 
many trainees will need no assists at all, especially if the film is shown twice. 

(5) The pictorial book program does a very creditable training job, despite its lack 
of audio and its inability to represent motion; it was roughly comparable to the movie 
programs in time required, and comparable to the Army program in number of assists 
(but requiring significantly more assists than the revised film program). 

(6) Developing a film through tryouts and revisions is promising as a research 
method, and in this experiment the development of the revised film yielded a coherent 
set of principles for producing demonstration films. 
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Comparison of Pictorial Techniques for 
Guiding Performance During Training 



INTRODUCTION 



For most soldiers, many daily tasks involve rather simple procedures or responses. 
For example, they might have to assemble or disassemble their weapons, or be required 
to fill out standard Department of the Army printed forms. The required responses are 
simple enough that even a novice can respond correctly if each step is demonstrated just 
before he performs it. For efficient training on such tasks, the guidance method is 
especially promising. The guidance method consists in putting the man in a realistic work 
situation, and indicating the required responses, one step at a time, as he performs his 
task, This report is concerned with the efficiency of various forms of guided practice. 



RELEVANCE OF PRACTICE ACTIVITIES 

Many formal studies, as well as common observation, indicate the effectiveness of 
guided learning for many kinds of tasks, (e.g., see references 1^ through T2 under 
Literature Cited). Perhaps the most arresting feature of the guided learning method is 
that the practice activity is a direct execution of the required job performance — a striking 
contrast to the high degree of job irrelevance so commonly found in training courses. 

The relevance of practice under programed instruction, 1 with its careful analysis of 
Instructional objectives (13, 14, 15), explains a large share of its commonly found 
superiority over conventional teaching methods. Yet even compared with a carefully 
developed linear program, Shettel and Lindley (16) found that students could learn the 
phonetic alphabet (a=alpha, b=bravo, etc.) in about one-third the time through a self- 
administered drill with little booklets merely containing the pairs to be associated. Such 
booklets, like flash cards, can be considered a guidance method applied to paired- 
associates tasks. 2 However, in order to benefit from using the guided learning technique, 
one must determine the kinds of tasks for which it is appropriate, and the sort of guided 
learning which is most likely to be effective. 



APPROPRIATE KINDS OF TASKS 

Tasks that are structured around equipment, devices, or some other special environ- 
ment are especially good candidates for guided learning, as might be inferred from the 
phrase, “in a realistic work situation,” in the definition of the guidance method. The 
realistic work situation offers two kinds of advantages: (a) The actions can be practiced 
with respect to an appropriate stimulus structure; and (b) manipulation of the equipment 

1 For present purposes, programed instruction may be defined as instruction based on careful anal- 
ysis of objectives, active practice of the behavior specified by the objectives, and repeated revisions on the 
basis of careful tryouts with representative students. Although guided learning, if carefully developed, 
might thus qualify as programed instruction, the term “programed instruction” has generally referred to 
a broader area including more abstract or classroom-type courses, 

2 The term guided learning is generally reserved for serial or procedural tasks, as might be inferred 
from the phrase step by step in its definition. With paired-associates or nomenclature tasks, the term 
prompting is more generally applied. However, both terms involve indicating or telling the correct response 
before the student has an opportunity to guess. 



may reveal critical task characteristics (response-produced cues) that would not otherwise 
be apparent to the student* The importance of the first factor was demonstrated by 
Miller (6) by providing procedural checklists to presolo flight students to guide their 
practice* Miller found that students who practiced in a cockpit mockups made only about 
half as many procedural errors in their subsequent presolo flights as students who 
practiced in ordinary chairs, (The errors were as noted by the flight instructors in their 
flight logs*) Others have found that the rather low fidelity of such stimulus structure does 
not seem to degrade effectiveness of practice (17, 1 18, 19, 2 ). 3 

Presumably, a somewhat higher level of equipment fidelity would be needed if 
manipulation were to reveal significant equipment characteristics (advantage ‘‘b”). For 
instance, in learning to assemble or disassemble a weapon, and to see how it works, 
subjects would want to practice with the equipment rather than with photographs alone, 
because the equipment is necessary in order to get the feel of spring pressures, latches, 
detents, and so forth, or perhaps to look at a part from a viewpoint not shown in a 
photo (both procedures involving responses producing cues which otherwise are not 
available). 

On the other hand, tasks that do not involve critical environmental features, or that 
entail critical conceptual components, may not be readily amenable to simple guidance of 
the overt actions* Thus, 'Weiss, et aL (20), employing a geometric construction task, 
compared the efficiency of demonstrating the whole task (followed by practice) with 
various strategies of guided practice (employing smaller units of demonstration-practice). 
They found, unexpectedly, that the guidance strategies did not lead to any clear or 
reliable superiority of test performance, even though guidance did lead to superior 
performance during practice— that is, guidance enabled students to make more nearly 
perfect drawings during practice, but this superiority did not result in better subsequent 
test performance* 

Weiss, et aL concluded that the task was not the sort to which their theory (various 
forms of the general guidance concept) applied. Their tentative explanation was that the 
task was complex not in the sense of being a long chain of separable acts, but it was 
conceptually complex in that each step was dependent on anticipation of subsequent 
steps, rather than on external cues from the environment* In conceptual tasks, the overt 
behavior which is guided may thus be trivial if it is not accompanied by the conceptual 
content. 



PROMPTING VS. TRIAL AND ERROR 

Several experiments on programed instruction were investigations of the effectiveness 
of prompting ; defined as indicating to the subject the correct response before he has an 
opportunity to respond* Although such prompting experiments have generally been 
conducted with paired-associates tasks, the results should also be related somewhat to the 
guided learning technique and in this report the term prompt will be extended to include 
the indication of the desired response in procedural tasks, A number of experiments have 
shown superiority of prompting responses over trial and error learning (21, 22 , 23 , 24), 
especially during early trials (25)* Cook and Spitzer (26) found that forcing a student to 



1 Work Unit RINGER, Fidelity Requirements for Training Devices, HumRRO Technical Report 65-4. 

2 Work Unit STRANGER, Long Term Memory of Motor Skills, HumRRO Technical Report 69-1. 

3 Similar results were obtained by Wallace W. Prophet, and H. Alton Boyd of HumRRO Division 
No. 6 (Aviation) in a study of the relative effectiveness of Device 2-C-9 and a photographic cockpit 
mock-up device in teaching ground cockpit procedures for the AO-1 Aircraft, under Work Unit TRADER, 
Developing Guidance for Establishing Requirements and Characteristics of Training Devices, in June 1962. 



guess actually interferes with learning; apparently incorrect guesses lead to formation of 
incorrect associations. Yet there seems to be some advantage in responding without 
prompts. 

Angell and Lumsdaine (27) report an experiment in which they prompt three- 
fourths of the responses, and they find this procedure superior to continuous prompting. 
These trends seem to indicate that learning with prompts will be relatively efficient, 
compared with trial and error, in tasks where the student population is unlikely to 
discover the right responses, or when they are especially likely to make errors. Thus, 
prompted responses are apt to constitute more efficient practice than trial and error 
when (a) the associations are arbitrary, or (b) the equipment is so complex as to make 
the associations seem arbitrary, or (c) subjects do not have the component skills and their 
attempts are for this reason unlikely to be successful and they are unlikely to understand 
their errors, or (d) the consequences of error are severe, as in dangerous tasks, (Annett 
and his associates, 28, 29, 30, have noted a relatively bold response tendency in their 
unprompted subjects during discrimination learning.) 

However, in reasoning tasks, such as decision making, one has time to consider 
incorrect alternatives, and recognizing them as wrong in the particular situation may be 
expected to lead to more reliable discrimination of the correct choice. Pressey (31) has 
long been an advocate of using plausible, often-chosen, wrong answer choices in devel- 
oping discrimination in conceptual material. 

Size of Unit Prompted 

If prompts are to be used to guide performance in procedural tasks, the size of each 
demonstration practice unit must be established. Generally, demonstrating the whole 
performance to students before they begin practice has been found less efficient than 
prompting (by demonstrating) somewhat smaller segments (8, 4, Jl, 3, 32). Comparatively 
short units are prompted when one supposes that parts of longer demonstrations are apt 
to be forgotten before practice begins. Demonstrations of whole tasks, or of segments too 
long to be remembered, are apt to lead to the same kinds of inefficiencies as trial and 
error learning, but to a somewhat lesser degree (to the extent that some parts are 
remembered). 

One might expect the most effective unit to be the longest demonstration a student 
could be exposed to before his ability to reproduce it was degraded, which Sheffield and 
his associates call the demonstration-apprehension (D-A) span (4, 8). Of course, the D-A 
span varies with individuals. Margolius and Sheffield found that poorer learners, as 
indicated by final test scores, chose shorter demonstration segments before practice; 
similarly, Gropper (33) found a significant interaction between IQ and optimal length of 
demonstration unit. Also, tasks are not divisible without limit, but have natural units; the 
finest division is almost always somewhat smaller than the D-A span (4, _B). Perhaps 
related to the optimal length of the D-A span are findings of Margolius, et al. (5), who 
found it more effective to have students practice each unit twice before going on to 
practice the next unit, rather than practicing the complete performance in sequence 
twice. 

Certain Practical Considerations 

In practice, however, the optimum length of demonstration is apt to depend upon a 
conglomeration of classroom variables which might be termed logistic (e.g., student- 
instructor ratio), and these variables are indeed pertinent to the experiment reported 
here. It is not merely that these classroom variables have an effect, but that some kinds 
of deviation from the optimum are apt to be much more crucial than others. 
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For instance, with a minimum of instructors, it is better to somewhat overprompt 
than to underprompt, since failure to give a needed prompt is apt to leave a student at a 
loss until an instructor is available, while giving too many prompts will reduce efficiency 
of practice only slightly. The effects of overprompting may be further reduced by 
allowing a subject to control or ignore the prompts, or to anticipate (perform in advance 
of) the prompts so that they serve merely as confirmation. 

These considerations are important in terms of the fact that, in designing practical 
training courses, one attempts not only to approximate optimum conditions, but 
especially to avoid the gross inefficiencies so common in training courses. 



Properties of Prompts 

Although sometimes verbal prompts are sufficient (e.g., 6), the most widely used 
form of guidance is a demonstration (or demonstration film), accompanied by a narrative. 
Many production features of demonstration films have been shown to increase the 
effectiveness of practice. One should allow time for responding (24, 34, 35). The 
student’s attention may be directed to the relevant task cues by testing (36, 37, 38, 39, 
40) or by animation (arrows, etc., 41) while avoiding embellishments that are~irrelevant 
(42) . Instructional narrative can aid instruction (34, 43, 44, 45), as can motion (46) and 
slow motion (35). The camera angle should represent the learner’s point of view (46). 
Since there is evidence to suggest that the hands of the demonstrator may sometimes 
tend to obscure critical cues (46), special care should be taken by the demonstrator. 

One may increase perceptual vividness (47) using camera techniques. One especially 
promising means of making vivid the relationship among various parts of the equipment 
is the implosion technique (48), used to teach assembly. This technique consists of a 
series of stills, presented so that the parte appear to pop into place, thus, it is a dynamic 
reconstruction from an exploded view of a system. The implosion technique is involved 
in the experiment to be reported here. The experiment also concerns the repetition of a 
demonstration, which has also been found effective in other experiments (49, 50, 51, 
52), — 

Media for Prompting 

The relative advantages of different media for prompting, say movie vs. book, may 
depend not only on the effectiveness of the stimuli, but also on logistic factors of the 
sort mentioned earlier. The natural advantage of the realistic motion stimuli in a movie 
might be offset by the fact that in a book the learner is free to look back over pictures 
Mid instruction. Also, with a book one is not forced to view a demonstration for a fixed 
period, and it is easier to adapt the book presentation to individual rate differences. Also, 
a book may be available for review or even guidance on the job (as in equipment 
maintenance), which might be more difficult or impossible with other media. 

PROGRAM DEVELOPMENT 

A significant feature of programed learning is development of programs through 
several cycles of tryout and revision with novice learners, and Cropper has demonstrated 
the value of such empirical development for visual demonstrations ( 53 , 54, 55 , 56). The 
process should be useful, not only for developing particular programs, but also in 
developing the general principles of our training technology, if we note the changes made 
and the reasons for making them. When the demonstrations are for very short natural 
units, failure to perform a step is hardly attributable to simple forgetting, but rather to a 
failure of communication; even hesitations may give some clue as to possible 



improvements. This kind of evidence is likely to oe very sensitive to subtleties of 
technique, and it seems to be a promising research method. 

The reasons for malting particular changes are apt to recur during program develop- 
ment, and may be organized into a coherent rationale. Although a principle may be 
confirmed only weakly by any particular instance of change, the evidence from several 
varied instances may be considered somewhat stronger, especially when the principles are 
interrelated in a nomological net, that is, a systematic set of principles (the classic 
method for scientific theory, 67, p. 290), Also, problems which actually arise are more 
apt to be a representative sample of future difficulties than problems formulated on an a 
priori basis. 



PURPOSE AND HYPOTHESIS 



The experiment described in this report was conducted in order to establish some 
effective general methods for developing and using demonstration materials — film or 
book— for procedural tasks. An effective film (or book) is one that yields mastery of the 
task in minimal training time, and with minimum assistance from instri tors; thus, the 
criteria of effectiveness were (a) the amount or training time spent on it, and (b) the 
number of assists given during training. 

The major experimental variables correspond to some general hypotheses about 
practices which seem likely to reduce training time or amount of assistance: 

Hypothesis 1: Having the trainee practice each step immediately after it is 
demonstrated, rather than after the complete demonstration, will reduce 
training time or number of assists, or both. 

Hypothesis 2 : Revising the film on the basis of student performance will 
subsequently reduce training time or need for assists, or both. 

Hypothesis 3: Showing the film twice (instead of only once) will reduce 
training time or need for assists, or both, and such an effect may depend 
upon the other treatments given (with respect to hypotheses 1 and 2), 
Hypothesis 4 : Use of the implosion technique in presenting the various com- 
ponent groups will yield better perceptual organization and thus reduce 
training time or assists, or both. 

Hypothesis 5: The effectiveness of a picture guide book will be close enough to 
the movie to be appropriate for many training situations. 



METHOD 

A complex factorial experiment was conducted to compare the efficiency of various 
methods of instruction on disassembly/assembly of the M-73 machine gun. The instruc- 
tional variations included various ways of instruction by sound movies, and a pictorial 
profpfamed book. 



DEMONSTRATION FILMS 

Army Film . From an official Army training film on the M-73 machine gun, the 
portions which actually demonstrated the general disassembly and assembly on the 
weapon were extracted and spliced in sequence. This condensed version of the film is 
much more directly relevant to the soldier’s immediate performance than the uncon- 
densed version under ordinary viewing conditions, and is part of a general series of films 
on the M-73, most of which is not directly related to actions required of the soldier. 



Revised Film, During exploratory experimentation the film was tested on novice 
soldiers, various shortcomings became apparent, in spite of the fact that the film was 
chosen because it had seemed especially clear and effective. (The changes are discussed in 
detail in the last section of this report.) Some of the shortcomings were violations of 
classic principles of demonstration films (e.g., the camera angle should be from subjective, 
i.e., over-the-shoulder, viewpoint, 48), 

A revised film was developed through several cycles of trial and revision with 
novices, for experimental comparison with the original Army film, to determine the 
extent of improvement, and to document the kinds of changes which underlie the final 
version. 



VIEWING METHODS 

Interspersing Practice. Each version of the film was prepared for viewing two ways: 
continuously, with practice on the weapon only after the complete film had been viewed; 
and step by step, with practice of each step on the weapon immediately after the step 
had been viewed. In relation to past standards (4, 8), these would be considered very 
small natural units, 28 steps in the film. The extreme smallness of steps facilitated the 
development of the revised film. With such small steps, any mistakes or even hesitations 
could be attributed to ineffective communication, since simple forgetting could be ruled 
out. 

Repeated Viewing . It seemed reasonable that an extra viewing of the whole demon- 
stration film at the start might be worthwhile, and that the effects of such repetition 
might depend on the other treatments given — that is, an interaction effect. Consequently, 
each of the two viewing methods was subdivided into one viewing and two viewings. The 
schema for these treatments is illustrated in Figure 1. 

All subjects who viewed the film twice first viewed the film without interruption; 
subsequently, the continuous viewing subgroup again viewed the film without inter- 
ruption, and the step by step subgroup practiced each step right after he viewed that 
step. 



TYPE OF INTRODUCTION 



Because of the promise of the implosion technique (48), alternative introductions 
were prepared, each lasting two minutes. In the Army version, the parts were grouped on 
a display board, with a title printed under each group (e.g., the receiver group), and the 
camera panned around the board as each part and each group was named on the audio 
channel. In the imploded version, an animation technique was employed so that the 
groups would appear to slide out abruptly, then fall into their component parts; each 
group and its parts would be named on the audio channel, and the printed group title 
would appear at the appropriate time. After the weapon was thus disassembled, the 
process was reversed, with the parts falling together to form groups, and the groups 
popping back into place on the weapon. 



PICTORIAL PROGRAMED BOOK 

A pictorial book, designed for the same task, was evaluated in comparison with the 
various film treatments. Ware and Cons tan ti n ides (58) have described this book which. 



Schema of Film Viewing and Practice 



Viewing 

Method 



Continuous 



One ) 
Viewing \ 



Step-by-Step 



v- 



~= Film, one step 









Two 

Viewings 




Figure 1 



like the revised film, was developed by testing with trainees. The subjects under the book 
condition were all run under the same procedure. 



EXPERIMENTAL DESIGN 

Thus, we have a 2 x 2 x 2 x 2 factorial design for the film treatments: Army vs. 
revised film, step-by-step vs. continuous viewing, one viewing vs, two viewings. Army 
introduction vs, imploded introduction. 

In six replications, 66 subjects were run individually under the 16 film conditions. 
In addition, 48 other .subjects were run individually using the pictorial programed book 
which covered the same task (58), to provide a media comparison for each of the two 
versions of the film. Although the book was developed by tryouts with novices, its 
development probably was not so extensive as that of the revised film. The experimental 
design is illustrated in Figure 2, 



SUBJECTS 



The 144 subjects were basic trainees who had no experience with the weapon; they 
were assigned at random within each replication, A stack of 24 cards was prepared, each 
card listing the conditions of one cell of the experimental design (16 cells for the film, 8 
for the book), and the cards were drawn at random to determine the condition for 
q ling each subject. 
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Number of Subjects Run Under Various Conditions 







Army Film 


Revised Film 
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Method 


Army 

Introduction 


Imploded 

introduction 


Army 

Introduction 


Imploded 

Introduction 


Subjects 


One / 
Viewing \ 


Continuous 


6 


6 


6 


6 


24 


Stepby-Step 


6 


6 


6 


0 


24 


Two ) 

ViewingsS 


Continuous 


6 


6 


6 


6 


24 


Step-by-Step 


6 


6 


6 


6 


24 




Total 


24 


24 


24 


24 


96 


Pictorial Programed Book 


48 



Figure 2 



The subjects In an Army manpower pool vary over time periods (e.g., during June 
and July a disproportionate number of college graduates may be drafted and are 
therefore apt to be in the pool). The replications (i.e., one subject for each of the 24 
treatment combinations constituted a single replication) were run successively so that the 
variation among replication means could be tested to see whether some time-related 
factor was indeed significant. 

If for any reason a subject was eliminated from the experiment, he was replaced by 
the next man to he run. Five of the early subjects were eliminated because of misunder- 
standing between the experimenter and the Work Unit leader on experimental procedures. 
Three subjects were replaced because of equipment failures. 



APPARATUS 

The subjects were run individually in a room arranged as in Figure 3, An M-73 
machine gun was in front of the subject, its receiver group bolted to the table to 
facilitate the task. An indirect light (7Vz watt) was built into the table so that the subject 
could distinguish the S and F stamped onto the backplate. There was room on the table 
for laying out the parts as in the demonstration. 

Under the film conditions the subject viewed the movie on the rear projection 
screen (image size approximately 31 x 42 inches). Under the step-by-step film conditions, 
two seconds (48 frames) of black leader were spliced between steps; the leader was the 
experimenter's signal to turn off the projector (from a button on his console). Except for 
the black leader, the films for continuous and step-by-step treatments were identical for 
otherwise comparable groups. 

As the subject finished practicing each step, he would press the green button to start 
the projector for the next step. Three standard Army 1 6mm sound movie projectors were 
used, No* 3 for the introduction. No. 1 for disassembly, and No. 2 for assembly. 
Projectors 1 and 2 had a special feature in that while one projector was in use, the other 
would be rewinding. At the end of the film, a spring contact would sense a notch in the 
side of the film that stopped the projector automatically. Thus, the demonstration could 
be shown repeatedly without delay. 



Arrangement of Experimental Room and Equipment 
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The experimenter could control the projectors from his console, which was 
especially arranged and labeled for the purpose. He also controlled a marker pen for an 
Esterline Angus 1 event recorder; another Esterline pen recorded automatically the fact 
that a projector was in use. 

Three ceiling lights controlled by a dimmer switch provided general room illumina- 
tion, which was left at a moderate level for all conditions, since the projectors were 
bright enough (750 watt bulbs) to project a clear image in the lighted room. 

The same general circumstances applied to the book condition, except that the 
projectors were not in use and the pictorial programed book was provided. 



PROCEDURE 

Rather extensive but informal exploratory experimentation was conducted: (a) to 
develop the revised film, (b) to develop the special performance recording forms, and 
(c) to develop and practice the introductory remarks and experimental procedure. All 
subjects were run by one experimenter, who also helped to develop the procedure. 

Special performance recording forms were developed. The version of the form for 
use with the Army film is presented in Appendix A; for the revised film and book 
treatments, comparable forms were also prepared, modified slightly according to the 
differences in the treatments. Using these forms, the experimenter could record errors or 
the need for assistance by checking an appropriate item, and later write in the per= 
form an ce time for each step. 

The brief introductory remarks and instructions, though not memorized exactly, 
were substantially as given in Appendix B. When Instruction began for subjects in the 
film groups, they first saw a two-minute introductory film, as described earlier in “Type 
of Introduction.” Then the subjects who were to view the film twice would view the 
whole disassembly /assembly film demonstration without interruption; then (a) the sub- 
jects in the subgroups who were to view it continuously would have a second uninter- 
rupted viewing, then their first practice trial, and (b) the subjects in the subgroups who 
were to view it step by step would have another viewing, interrupted for practice of each 
step, which constituted the first practice trial. The subjects who were to view the film 
once would view it continuously or step by step (see Figure 1). With the book treatment 
subjects did not see any film and used the book on their practice trial. 

After die first practice trial, subsequent trials were run under test conditions 
(without the film, but with assists as required). Under the book conditions, however, if 
the subject needed an assist (as defined later) he was allowed to continue using the book 
for that trial, since after his assist it would be impossible for him to meet the criterion 
on that trial. This practice seemed closest to normal classroom conditions, since the book 
cam be managed on an individual basis, while movies are generally shown to the whole 
group. 

During all trials, the experimenter provided correction or assistance only when the 
subject's performance indicated a need for such help, after which the experimenter would 
check the corresponding item on the recording form. The contingencies for providing 
correction or aid were as follows: If the subject began to do something dangerous, or 
directly asked for help, an assist was provided immediately. If he was looking at or 
manipulating something relevant, something which might eventually lead to success, a 
rather long interval of several seconds would be allowed before the experimenter inter- 
vened- But if the subject were looking at or manipulating something irrelevant, or if he 

identification of this product is for research documentation purposes only; this listing does not 
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apparently gave up, only a few seconds would be allowed. It seemed that these standards 
were easy to follow in practice, with rather high agreement between observers on 
particular cases, and a rigid procedure with a stopwatch seemed needlessly clumsy. The 
subjects did not seem to seek unnecessary help, since their objective was to perform the 
whole task without error and without aid, after which they would be released from the 
experiment. 

After the first three replications were run, a minor change was introduced because it 
appeared arguable that step-by-step viewing entails a somewhat spurious disadvantage 
compared with continuous viewing; unlike continuous viewing, step-by-step viewing does 
not permit the subject to meet criterion on his first trial. In fact, in the first three 
replications, the criterion had been met on the first trial by eight of the 24 subjects who 
viewed the film continuously. On the other hand, it might he argued that such a 
disadvantage is intrinsic to step-by-step viewing, and that whatever the subject’s zeal state 
of knowledge during the first trial, there is no practical, classroom technique under 
step-by-step viewing for finding the high-skill subjects and dismissing them after the first 
trial. Since the point is debatable, during the last three replications all subjects had to 
undergo at least two trials, so that there would be a basis for comparison of the times 
required under the two conditions. 



RESULTS ON MAJOR VARIABLES 
TIME TO REACH CRITERION 

Table 1 presents the analysis of variance of various film treatments in terms of the 
total practice time (in seconds) required to reach the criterion of one perfect trial 
without an assist. Only performance time is involved, not time required to show the 
films. 

To obtain a pooled error term, the residual variance was adjusted by compensating 
for differences among replication means, which might reflect the vaiying sources from 
which the subject population was drawn. The interactions with replications thus con- 
stitute the pooled error term; if these interactions entailed appreciable effects besides 
experimental error, they would tend to bias the F tests toward nonsignificant results. The 
overall effect of replications was not significant. 

Statistical significance (p<-01) was obtained for the BxC interaction (number of 
viewings X viewing method). Table 2 shows the pattern of means underlying the BxC 
interaction, and the significance of the apparent pattern is definitely confirmed by 
analysis of variance of the simple effects: viewing the film twice (rather than only once) 
is of significant help for those who get a continuous viewing, but does not help those 
who get a step-by-step viewing with practice interspersed. The average of these simple 
effects constitutes the overall effect of C (one vs. two viewings), which was also 
significant. 

Analysis of the simple effects on the other dimension reveals that, if the film is 
viewed only once, the step-by-step viewing group learned somewhat faster, but the effect 
is not statistically significant. If the fiim is viewed twice, the step-by-step viewing group 
took significantly more time to learn (pC.Ol). Procedures for these analyses are given by 
Winer (58, pp. 174-178, 213-215, 230-238). 

To take account of the time required for an extra film showing, one would add 370 
seconds for the Army film, 470 seconds for the revised film, or an average of 420 
seconds. (The introduction took an extra 120 seconds for all film treatments.) 

Thus, for the continuous viewing treatment, the extra viewing appears to save about 
as much practice time as it takes to watch the film. But for the step-by-step viewing 
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Table 1 



Analysis of Variance: Total Performance Times 
Required to Reach One Perfect T rial 8 



Source 


df 


MS 


F 


A 


Version of Film 


1 


65,573 


<1 


B 


Viewing Method 


1 


184,713 


1.50 , 


C 


Number of Viewings 


1 


1,041,458 


8.48** 


D 


Type of Introduction 


1 


124,056 


1.01 




Replications 


5 


125,701 


1.02 


AB 




1 


233,938 


1.90 


AC 




1 


219,746 


1.79 


AD 




1 


7,089 


<1 


BC 




1 


1,178,158 


9.59** 


BD 




1 


97,473 


<1 


CD 




1 


10,395 


<1 


ABC 




1 


51,661 


<1 


ABD 




1 


658,856 


5.36* 


ACD 




1 


84,668 


<1 


BCD 




1 


8,306 


<1 


ABCD 




1 


52,313 


<1 


Pooled error 


75 


122,870 




Book Program vs. Army Film t- 


9.77** 






Book Program vs. Revised Film t= 1Q.40 # * 







a **indicates statistical significance at the .01 level. 

•indicates statistical significance at the .05 level. 

Table 2 

Mean Times for the Significant BxC Interaction 8 
in Viewing Film 



Step-by-Step 

Viewing 



Continuous 

Viewing 



One Viewing 

C 

Two Viewings 




974.5 



987.7 

981.1 



Significance of simple effects; 

(1) NS 

( 2 ) <01 

(3) NS 

(4) <01 



/#it m m nn n ~ 






(3) — ► 1108.3** 




1041.4 




(2) 




(4) ► 678.4 ■*— 




833.1 


893.4 


937.2 



^Number of Viewings (C) x Viewing Method (Bl. 





treatment, the extra viewing takes time without appreciably reducing required practice 
time. 

The difference between film versions favored the revised film slightly, but the 
difference was not significant. The mean difference between types of introduction was 
not significant statistically; in fact, the actual difference tended to favor the Army 
introduction. The ABD interaction is statistically significant (p<.05), and there seems to 
be no obvious explanation. The pattern of means is given in Table 3. 



Table 3 

Mean Times for the Significant AxBxD Interaction 3 
in Viewing Film 











a i 

Army 

Film 


A 2 

Revised 

Film 




Bl 


Step-by-Step Viewing 




Standard Introduction 


978.3 


975,8 


977,0 


d 2 


Imploded Introduction 


1134.9 


835.4 


985.2 


b 2 


Continuous Viewing 


Dl 


Standard Introduction 


893.8 


757.3 


825.5 


d 2 


imploded Introduction 


846.5 


1075.8 


961.2 








963.4 


911.1 





“Version of Film (A) x Viewing Method <B) x Type of Introduction <D> . 



Both film versions (Army and revised) required much less practice time than the 
book program, and each of the differences is statistically significant (pC.Ol, based upon a 
t test in which the variance estimate for the two film treatments was calculated from the 
pooled error term). If the showing time of the film is added to the overt practice times, 
the differences virtually disappear (and are not significant statistically). 

No analysis for the part-task time scores was attempted, because of the lack of 
significance on the major dimensions for which a subtask analysis might be relevant. 



“ASSISTANCE" TALLIES 

Tables 4 and 5 list the number of assists given to various treatment conditions. The 
“introductory treatment” variables (concerned with the implosion technique) showed no 
consistent trends. For formal statistical tests, the data in Tables 4 and 6 must be in the 
form of distributions. (Data for forming these distributions are in Appendices C and D.) 
The statistical tests used are likely to be on the conservative side, in that any effects 
attributable to one dimension of the experimental design will tend to obscure the effects 
attributable to the other dimensions. 

On the first trial, step-by-step viewing sharply reduces the number of assists needed 
(Mann- Whitney U test, pC.OOi). The revised film also sharply reduces assists on the first 
trial (Mann- Whitney U test, pC.001 ), and among subjects who viewed the revised film 
step by step there was almost no need for assistance; 
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Table 4 

Errors or Assists on First Trial 



Film Version 







Army vs. Revised 


Total 




IA 

2 ** 
Q C 


59 (once) 


55 (once) 




■a 

© 

s 


A g 
1 


+31 (twice) 
90 


+10 (twice) 
65 


155 


an 

£ 


£ 

<u ^ 


18 (ones) 


3 (once) 




5 

to 

> 


^ A 
■9 ! 

CL 

Si 


+21 (twice) 
39 


+1 (twice) 
4 


43 




CO 


129 


69 


198 



Table 5 

Errors or Assists After First Trial 

Film Version 



Army 



Revised 



Total 



trj 

I f 

■g fl 

€ g > 

Ji O 

| s 
its* 
! p 

p 

CO 



4 (once) 
+1 (twice) 

If 


2 (once) 
+0 (twice) 
2 


7 


11 (once) 


14 (once) 




+17 (twice) 


+12 (twice) 




28 


26 


54 


33 j 


28 


61 



An extra viewing of the film also reduced assists significantly (Mann-Whitney U test, 
p<. 02), but as shown in Table 4, the apparent benefits from the extra viewing are due 
entirely to the differences within the fp^oups who viewed continuously; this pattern is, of 
course, the same as that found in the practice time data presented above. The difference 
associated with type of introduction, which slightly favors the Army introduction (as did 
the practice time data), was not significant. (Mann-Whitney U test falls just short of the 
.05 level with a two-tail test.) The book treatment, compared with the conglomerate of 
the Army film treatments, had no significant effect on first trial assists, but when 
compared with the revised film treatments, required significantly more assists (Mann- 
Whitney U test, p<.001). 

On second trials, there were so many cases of zero assists that the Mann-Whitney U 
teste were replaced by x 2 teste (59, p. 231) using the categories “zero” vs. “more than 
zero” assists. (No subject in any film treatment group needed assists after the second 
trial.) On the second trial, there was a sharp reversal of the trend of assist data associated 



with viewing method; although the step-by-step presentation resulted in fewer assists on 
the first trial than continuous viewing, step-by-step viewing resulted in significantly more 
assists on the second trial when the prompts were withdrawn (p<.001). However, the 
first trial with step-by-step viewing resulted in some learning, since these subjects per- 
formed better on their second trial than the continuous viewing subjects had done on 
their first trial (Mann-Wliitney U test, pC.OOl)* 

The revised film on the second trial shows a small (but not statistically significant) 
advantage* over the Army film. The lack of significance is not surprising in view of the 
heavy concentration of zero assists in both groups. The two viewings condition yields 
means virtually identical to those of the one viewing condition. This result is consistent 
with the other trends on this variable, since the trends consisted of differences within the 
continuous viewing group, few of whom required any assists at all on the second trial. 
Type of introduction did not result in significant differences. 

After the first trial the book treatment is associated with somewhat more assists 
than the Army film conditions, but the difference is not significant statistically. The 
book treatment does result in significantly more assists than the revised film conditions 
<X 2 ,P<.01), 



DISCUSSION OF EXPERIMENTAL RESULTS 



With reasonable extrapolation the results of this laboratory experiment can be 
related to the sorts of problems likely to be encountered in designing practical training 
programs. Perhaps the first notable trend is that there were no significant differences 
between the methods (overall main effects) in terms of total instructional time required 
(including any demonstrations). All the training conditions insured that the great bulk of 
the student’s time was spent on relevant activities; for instance, the Army film was 
severely edited, and only the actual demonstrations of the relevant task were retained. 
The assistance of the experimenter would insure that no great time periods were lost as a 
result of confusion. The data for assists, however, show many sharp differences, and the 
level of assistance given under many treatment categories is clearly excessive in relation to 



the general availability of instructors. 

The very low number of assists when the revised film is viewed step by step 
demonstrates how reliably one can communicate this kind of skill by a demonstration 
film. In classroom practice, one might show a film step by step by allowing everyone to 
finish each step before proceeding with the next step. By having a few seconds of black 
leader between steps, this technique can be used conveniently with conventional 
projectors. Probably one would want a second showing step by step to reduce need for 
assistance, but allowing the more able soldiers to anticipate (work somewhat ahead of) 
the demonstration, thus making it a self-test for them. If only an occasional assist were 



needed, it could perhaps be supplied by another student who understood the demon- 
stration. The difficulty of the particular task would determine both the number of trials 
needed and various other details of the training procedure, matters which should there- 
fore be worked out by trying each program with students. 

There is a price to be paid for using step-by-step viewing and for developing a film 
empirically, such as our revised version. The step-by-step presentation appears to start 
everyone at a fairly elementary level of learning; this is perhaps the best explanation of 
the fact that the step-by-step viewers did not seem to benefit from an extra viewing of 
the film before the step-by-step viewing (either in practice time scores or assist scores), 
since what they learned during the first viewing would duplicate the elementary sort of 
learning in the subsequent step-by-step viewing. This explanation is also consistent with 
the findings of Cropper (33), who noted that the optimum length of demonstration unit 
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tends to be longer for higher IQ students, and of Margolius and Sheffield (4), who found 
that the more capable learners were those who tended to choose longer demonstration 
units. 

By the nature of the step-by-step treatment, such guidance does not allow a student 
to demonstrate his competence on that practice trial. (Even on the rather complex task 
in this experiment, when the revised film was viewed twice continuously, 7 out of the 12 
subjects could perform the task without an assist on the very first trial.) On the other 
hand, step-by-step demonstration does apparently allow low ability subjects to learn tasks 
which by other training methods would be impossible (60). And in the perspective of 
general training practice, one generally is most concerned with rapid, businesslike progress 
for all students, rather than with the ultimate in efficiency. 

In some situations the step-by-step method may be considered needlessly clumsy. By 
use of a carefully revised film, developed by a process like the one described above, one 
may still train with a rather small amount of assistance. When viewed continuously, an 
extra viewing of the film seems to save about as much practice time as it takes to show 
the film, at the same time sharply reducing the need for assists, though the extra viewing 
appeared to be a waste of time for the step-by-step viewers. The step-by-step method 
seems to be very useful in film development, even if the final film is shown without 
interruption. 

Considerable time and effort were required to develop the revised film. Although 
such cost would be considered negligible for courses developed for a large number of 
students, in courses with few students the cost could not always be justified. 

The effort of developing a film could perhaps be reduced by applying the principles 
presented in the following section and in the literature. Somewhat abbreviated develop- 
ment might be appropriate for some courses, because one reaches the point of diminish- 
ing returns in later revisions, but if the demonstration film is worth producing at all, it 
would seem worthwhile to always conduct some tryouts and revisions. 

The pictorial book program produced mastery in amounts of time generally 
comparable to those for the film conditions, and the number of assists was roughly 
comparable to that for the Army film conditions. Apparently, the disadvantage of the 
book in not presenting moving stimuli or coordinated audio directions is compensated for 
by its natural advantage of flexibility in use: (a) The subject is not forced to view a 
presentation for a fixed period whether he needs it or not; (b) he can review at will the 
points he is unsure of; (e) often he can take a book program to the job in situations 
where a movie would be awkward or impossible. 

Although the revised film generally required fewer assists than the picture-guide 
book, especially under the step-by-step or the two-viewings treatment, the film was 
subject to a much more extensive development than the book, which was produced under 
a stricter production schedule. The pictorial programed books seem likely to become 
increasingly important as their techniques become further developed and for situations in 
which their umque advantages of flexibility are at a premium. 



RESULTS AND DISCUSSION OF 
PRINCIPLES UNDERLYING THE FILM DEVELOPMENT 

In revising the Army film for better communication (to reduce error, hesitation, and 
fumbling) the changes made and the rationale for making them were explicitly recorded. 
Since each change transformed an apparently ineffective segment of the film into an 
apparently effective one, the reasons for making the changes may in a sense be con- 
sidered results of informal experimentation. Although such instances may have little 



statistical status as evidence, they gain strength as they occur repeatedly and are 
interrelated in a systematic rationale. 

Two distinct advantages of this kind of evidence are its efficiency in terms of 
research effort, and its sensitivity in terms of detecting nuances of visual communication. 
The relation between communication and action is most direct. 

The process of validating films empirically is very sensitive to omissions or mis- 
leading presentation, but very insensitive to redundancy and superfluous detail. Hence, it 
is important to follow two general rules in preparing a draft version: (a) Be as brief as 
possible, searching for ways to condense and simplify, and (b) when in doubt, choose the 
most succinct treatment being considered, relying on subsequent tryouts to reveal 
omissions. Programers are always surprised, at first, to find which sections the students 
find easy, and which sections they find difficult. 

Although the revised film is a distinct improvement in general terms, the assist data 
on any specific item seldom support adequate statistical tests. One would have to have at 
least six instances of the need for assists to provide even a possibility of statistical 
significance at the .05 level. In the data for step-by-step viewing, there are two such items 
where significance is possible, and both— significantl y— favor the revised film (a ten-zero 
split on remembering to lift the feed tray, and a six-zero split on replacing the feed tray 
with the bullet ramp forward). 

A list of the principles organized in coherent form follows. Each principle was 
developed from reasons underlying actual changes made, and most of the rules were 
developed from several instances. 



Principles for Movie Development 



I. Content photographed 

A. Actor’s performance 

1. The performance (including motion, grip, stance) should approximate 
normal performance of the task, and should avoid grossly artificial postures, 
awkward reaching, extra manipulations which the student is not expected to 
imitate (especially if these involve dangerous or otherwise undesirable 
actions), and minimize the actor’s pointing to critical cues. (It is preferable 
generally to use another technique for cue emphasis, such as animation.) 
The Army film, in presenting a point on safety, demonstrated what the man 
was not supposed to do, so that a trainee copying the demonstration might 
get himself into a dangerous situation. 

2. The component movements, especially the critical ones, should be slow, 
clear, and distinct; the less critical (routine) motions should be easier, and a 
little faster. 

3. Normal performance may be modified somewhat to intensify suggestion of 
desired action (dramatic quality based on population stereotypes). For 
example, in pushing a button, a straight finger pointing in the desired 
direction of motion will suggest pushing. 

4. Normal performance may be modified somewhat to avoid obscuring critical 
cues or motions. (See also B.) 

5. Normal performance may be modified somewhat to indicate extra actions 
are not taking place. In illustration of this principle and the preceding one, 
the actor in the revised film pressed the trigger (which on the M-73 is a 
strange flap on the back) with his thumb and held the rest of his hand open 
and well clem* of the weapon, instead of using his palm, which in the Army 
version covered a large area of the back of the weapon. 
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B, Camera viewpoint 

1. Maintain essentially a subjective (or over-the-shoulder) point of view. 

2. Make no abrupt changes in viewpoint. 

3* To get at critical cues which cannot be seen from normal position: 

a* On large, stationary objects, pan around object, simulating the person’s 
head movements, 

b, On smaller, movable objects, turn the object (but slowly, so that viewer 
does not lose orientation), 

II. Emphasis on critical cues from the environment 

A. Animation 

1. You may emphasize (or exaggerate) intrinsic visual cues (e.g., you may draw 
attention to critical features on machinery by rubbing chalk on some edges 
to exaggerate the highlights). 

2. You may use animation devices (clearly extrinsic to task cues) to draw 
attention to critical parts, or to indicate the desired action (e.g., a circle 
around a part to be manipulated, or an arrow indicating the direction a part 
is to be moved), 

B. Sound cues 

1. You may need to restore certain critical sound cues, and synchronize them 
with the action. (It is common practice to use the audio for narrative, which 
may result in losing important task cues. Such cues generally serve as 
terminal cues, indicating when an action has been completed satisfactorily. 
Three such instances arose in revising the Army film.) 

C. Photographic technique 

1. Clarity may be enhanced by close-ups, lighting, resolution, focus. 

2. Composition may serve to direct attention through centering critical aspects, 
framing (cropping or close-ups), or eliminating distracting clutter from the 
background, 

3. Time usage may serve to emphasize importance of cues and actions. (Often 
only a tryout with novices will indicate which features are really critical to 
task performance, and which other cues would be discovered readily as the 
student carries out the indicated actions,) 

III. Language problems 

A, Timing of narrative. The narrative should lead, by a short interval, the action it 
directs, as if the actor were following the commands on the audio. 

B. Reference to objects. Ambiguous term-to-object correspondence may be clarified 
by the following techniques: 

1. Using one of the above-listed techniques, such as timing or animation 
arrows, to clarify the correspondence. 

2. Simplify and/or explain the terms used; use only relevant technical terms, 
and take time to explain as necessary. (For instance, in seating the feed 
tray, the Army narrative said, “Make sure the bullet ramp is to the front.’’ 
The revised film added, “The bullet ramp is the wide part of the slot, where 
the bullets drop through into the barrel,” and the slot was backed by white 
paper to attract attention and emphasize its shape.) 

3. Reference to action. Ambiguous term -to -ae ti o n correspondence (whether the 
action is a manipulation or the underlying mechanical dynamics) may be 
clarified by explanation (which should rely on known terms, associations, 
and population stereotypes). 

IV. Organization. The order of some steps, and the division of the action into natural units 
for trial, may be designed to capitalize on common associations of ideas. 
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Appendix A 

RECORDING FORM (ARMY FILM) 

Subject: # Name: cell_ 

batch S.N.: 



Trials 1 2 3 after 
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I. Checking weapon 

1 . *cover latch— lift cover 

feed tray up 

2. *eharging handle— not cocked 

—forgot 

3. *on “safe” 

•check 
•on “fire” 

4 ^release (fire) 

•close cover 








































































II. Cover group 

5. *eover off 

6 . *feed tray off 






















III. Backplate Group 

7, *guide rods and springs 

8 . *backplate 






















IV, Barrel and Bar. ext, 

hands not clear (safety) 

9. *eharger handle— forgot 

—not cocked 

10. ^buffer support lever 
•back and ou“ 

•support barrel 

11 , *breech block— forgot 

—couldn’t do it 


















































































V, Charger assembly 
12 , *ring 

•charger off 






















VI. Barrel jacket 

13, *pull back disconnector, 
rotate B, * B. J, 
•forward and off 






















Sequence of lay down 
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Appendix B 

INSTRUCTIONS 



Good-morning (afternoon), I m Specialist Pepper, Research Psychological Assistant. 
Welcome to the Human Research Unit. We’re an Army Organization working with a 
group of civilian research scientists through The George Wash in g to n University 
Washington, D.C. 

Directions I* Film Without Interspersed Practice 

You’ll be working with the M-73 machine gun, learning to disassemble and assemble 
it. We have a special movie which shows you how to do it. Pay attention, because after 
you see the movie, you’ll try to do the same thing yourself with the weapon in front of 
you. You may ask for help from. Specialist Pepper whenever you can’t understand or 
remember what to do next. Try to remember what you do, because you will repeat 
practice until you can go through the whole operation without help. 

After First Showing of Film (Before “Subject” Begins Disassembly) 

Be sure you check and clear the weapon before you begin the disassembly. 

After Subject’s First Perform ance 

Now, we’ll show the film again, and you’ll try the operation again. You’ll be 
through as soon as you can disassemble and assemble the weapon without help. 

Directions II: Film With Interspersed Practice 

You’ll be working with the M-73 machine gun, learning to disassemble and assemble 
it. We have a special movie which shows you how to do it, 

Th- movie will guide you through the disassembly and assembly operations. The 
movie will demonstrate the first step, then stop- and allow you to do that much. When 
you have finished the first step, push the green button and the movie will show you the 
second step, then stop while you perform that step, and so on, until you complete the 
disassembly and assembly of the weapon. You may ask for help from Specialist Pepper 
whenever you can’t understand or remember what to do next. 

Try to remember what you do because you will repeat practice until you can go 
through the whole operation without any mistakes. 

After Showing of Film and Before Disassembly 

Now you will begin the actual disassembly of the weapon, without the film. Be sure 
you check and clear the weapon before you begin. 

Directions III: Book With Interspersed Practice 

You 11 be working with the M-73 machine gun, learning to disassemble and assemble 
it. In front of you, there’s a special book which shows you how to do it. The book will 
guide you through the disassembly and assembly operations. The first page will illustrate 
the first step, and you will do that much. When you have finished the first step, turn the 
page and the next page will show you the second step as you do it, and so on, until you 



complete the disassembly and assembly of the weapon. You may ask for help from 
Specialist Pepper whenever you can't understand or remember what to do next. 

Try to remember what you do, because you will repeat practice until you can go 
through the whole operation without depending on the book. 

Before Second Time 

Now, you’ll use the book the same way, except that you may remember some of 
the steps before you see them pictured. So when you can, do the step first, then turn the 
page to check yourself with the book. You may see the step first if you wish. You will 
be through as soon as you can perform the operations without depending on the 
book— that is, as soon as you can perform each step, only using the book afterward, to 
check yourself. 
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Appendix C 

DISTRIBUTIONS OF ERRORS 



Table C-1 



Distributions of Errors or Assists on First Trial 
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Table C-2 



Distributions of Errors or Assists After First Trial 
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DISTRIBUTIONS OF TRIALS 



Table D-1 



Distributions of Trials to Criterion 
by Treatment 
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Hg L APG MD 


i r 


COMOT 


USA 


inst 


1 


CG 


USA CDC FXPFR IMCNTAT IQN CQMQ FT ORQ 
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COMOT 


USA 


HO AM 


2 


ENGNR PSYCHOL LAB PIONEERING PFS OIV ARMY NATICK LAPS NATICK MASS 


1 


CQMQT 


US ft 


ARTY «( 


1 


TECH LIB ARMY NATICK LABS NATICK MASS 


I 


COMOT 


If? A 


ARTY S( 


2 


INST OF LAND C9T ATTN TECH LIB Ft RELVQIR V A 


1 


CPM^T 


USA 


TRANS ! 


1 


RfDSTONF SCIENTIFIC INFO GTQ US ARMY M?L CDMD ATTN CHF DOC SiC ALA 


1 


CQMQT 


USA 


TRANS ! 



COMOT USA 5 CM EUROPE ATTN EQUC AOV A Q D 09172 NY 

OFC OF DOC TP I Mg D| V LIT £ PLNS USA 43MCiR SCH ATTN AHBAAS-DM 

COMOT 4PH¥ AVN 5CH FT RUCKER ATTN EDUC AHV 

DIP DF INSTR US MJL ACAD WEST POINT NY 

DIR QF MJlIT 1 NSTR Ul MILIT ACAD WEST POINT 

USA INST FOR MIL ASSIST AT T N L I M BLDG lST'ZSC-e FT BRAGG 

1ST ATTN COUNTER INSURGiNCY DEPT FT BRAGG 



€ SCH. ATTN CNF DEC OF OPS R FDSTONF ARSNL 
C TP. ATTN AJMCT FT MCCLELLAN 



SCM ATTN OIR OF ACADEMIC 0*5 FT HQLABIRD 
SCH ATTN PIR QF DOC £ LIT FT HOLABIRD 



TNG CTR ATTN ACOFS G3 



LIT L PINS FT GORDON 



TNfj 01 V FT MCCLELLAN 

PLNS £ OPS D I V FT MCCLELLAN 



CO FT HiJACHUCA SPT COMO USA ATTN TECH REF LIS 
SIXTH USA LIB DEPOT BLOC, m 13 14 pp.FS U c $AN F RAN 
PLNS OFC R P$yCH HDQTPIS USACQCFC P T Q 40 
CG FT OPD ATTN 03 t"NG DIV 

Die WALTER RigD ARMY INST HP R^s WALTER REED ARMY M£p CTR 
DIR WR AIR WALTER REED ARMY M£0 CTR ATTN N EUROPS v CHI AT DIV 
CD HQ AP M Y ENLISTED EVAL C TR FT 5ENJ HARR J SON 

tech lip sox 22 usacoc experimentation cdmd ft ord 

HUMAN FACTORS TEST Olv I AGHZ ) »JSAP HGSP (FGLIN AF B 
CO FRANKFOP.D ARSNL ATTN S<«u e A-N64QQ /2 02 -A. PA 
6TH RGN USARAOCDM FT BAK5P 

ATM ARM* mJl CHMO ATP Te AN5PQRT ABLE SAN FRAN 
PIN ARMY BO FOP AvN ACCIDENT RSCH F TRUCKS R 
CO P I C AT I NN Y ARSNL DCVEF N J ATTN SUM PA VC I 
LIB Q i f SLjePLV AGC Y C AM IRON STA VA 
CO USA TOC AG AG £¥ FT RENJ HARRISON I ND 
RI F M M< NASA ALA 

CO USA GET DEV6L CO«D TRANS A Of V FT EUSTIS 

CO ARMY COC INF AGY FT PENNING 

CO ARMY CPC ARMOR AGY FT KNOX 

CO US AP M Y COG A VN AGCY FT RUCKgR 

CO USA TNG CTR I FA J ATTN AK 3 5ITC-TT FT SILL 

CG USA TNG CTP g FT L SONAR 0 WOOD ATTN ACOFS G3 

CG USA IN* CTR ATTN AJICT-T FT SENNING 

CG USA TNG CTF INF ATTN ACOFS G3 FT OIK 

CG USA TNG CTR ATTN ACO e S G3 FT JACKSON 

CG USA TNG CTR INF ATTN ACOFS G3 FT LEWIS 

CG USA TNG CTR INF E FT CP D ATTN ACHES G3 

CG USA TNG CTR INF ATTN AC0F5 f*3 FT POLK 

CO USA Mgo TNG CTR ATTN DIP OF TNG FT SAM HOUS T ON 

CG USA AD CTR ATTN G3 ft BLISS 

CG USA TNG CTR INF ATTN AC0 5 5 03 FT C AMP3 £LL 

LI? ARMY WAR COLL CARLISLE BK5 

COMOT CCMO * GFN STAFF GO FT LEAVENWORTH ATTN ARCHIVES 

DTR OF MTLIT PSYCHOL * l.DR SHF US M I L | T ACAD WEST POINT 

US MIL1T ACAD WEST POINT ATTN LTB 

COMDT ASHY AVN SCH ATTN PIP nF INSTR FT PUCKER 

COMDT ARMY SFCUR AGY TNG CTR * SCH P? OEVENS ATTN LIS 

STIMSON LIS Mgg FLO SERV SCH BEOOKI ARMY MFD CTR FT SAM HOUSTON 

COMDT THE ARMOR SCH ATTN DOT FT KNCK 

COMOT ARMY ARMOR SCH FT KNOX ATTN WFAPONS DEPT 

COMDT USA CHAPLAIN SCH AT 7 N DO I FT HAMILTON 

COKDT ARMY CHEM CORPS SCH FT MCCLELLAN ATTN fiOUC ADV 

COMOT U|A FIN SCH ATTN CHF PQC DEV LIT PL N 01V ODDI INP 

USA FINANCE SCH FT BFNJ hARHISON ATTN PDUC ADV 

CnMOT ACJ GEN SCH FT BENJ HARRISON ATTN EDUC AOV 

COMDT US A I S ATTN EDUC ADV FT BCNNING 

COMDT USAIS ATTN A J I I5=D=EPBD FT BENNING 

HQ US ARMY aDJ BIN SCH FT 6FN J HARRISON ATT CQMQT 

LIB ARMY QM SCH FT LEE 

COMDT USA QM SCH FT LEE ATTN FOUC AOV 

COMQT ARMY TRANS SCH FT EUSTIS ATTN fOUC ADV 

CO USA SEC AGY TNG CTF L SCH ATTN I AT EV RSCH ADV FT OEVENS 

COMDT USA MIL POLICE SCH ATTN «»LNS £PROG QDOl FT GORDON 

COMOT US ARMY SOUTHEASTERN S IQ SCH ATTN EDUC ADV FT GORDON 

COMDT USA AD SCH ATTN CGI FT BLISS 

CO USA GRP CTR £ SCH OFC OF OPS ATTN 4H8N-Q APG MD 

ASST CQMQT army AIR niF SCH FT BLISS ATTN CLASSF TECH LIB 

CG USA FLD ARTY CTR £ FT SILL ATTN AVN OFCP 

COMOT DF= INTELL SCH ATTN SICAS D&PT 

COMDT AFMEO e ORCE S STAFF COLL NORFOLK 

COMDT USA 5IG CTR L SCH ATTN DOI FT MDNHDUTH 

COMDT JUDGE ADVOCATE PENSRALS SCH U QF VA 

DPTY CD M D T USA AVN SCH PLEMiNT G A 

PPTY ASST CQMOT USA AVN SQH iLEMFNT GA 

USA AVN SCH ELEMENT OFC OF DIR OP INSTR ATTN iOUC ADV GA 

faDUC CONSLT ARMY MILIT POLICE SCH CT GORDON 

rnMDT USA |NGR SCH ATTN EDUC AOV AH?BcS = i4 FT BEL VO I R 
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TV SCH ATTN DO I FT SI LL 
CM ATTN E'JUC SERVICES 01 V FT SUL 
ATI* g r ‘UC AUV FT S ILL 
ATTN DIP OF' PilC £ LIT FT EUSTIS 
ATTN LIA FT EUSTIS * 

USA INST FOP MIL ASST ATTN EDUC ADV FT B^AGG 
COMDT USA C£GSC ATTN ATSCS-OJ fSPWMi 

COMOT ARMY QM SCH ? 6 C □ I R OF NON RE 5 ID AC TV Y ATTN TNG MEDIA D]V V ft 

COMDT US* AF TY CCH ATTN LiP r T SILL 

CG USA SCH £ TNG G T P ATTN ACO p S 03 FT GORDON 

DIR C?f GOAD STUD £ RSCH ATTN FSHAV SCI «EP USACEGSC 

COMDT USA AD SCH ATTN AKBAA5-DL-EA FT BLISS 

COMOT USA AD SCH HIGH ALTITUDE MSL DePT FT BLISS 

DIR 0F GD BN QPNS DIPT USAIS FT SENSING 

DIP COMM FL^C. liS A 1 5 FT PENNING 

DIR ABN-AI^ MOBILITY. DEPT USAIS E T SENNING 

Cd USA StO CTF £ SCH ATTN ATSSC=DP-CQ1 FT MONMOUTH 

CG IJSA 5IG C TP % SCH ATTN ATSSC-FA FT MONMOUTH 

SECY OF .* * Y f PENTAGCN 

DC SUPERS DA ATTN CNF C +S Q I V 

DIP OF PEPS STUDIES £ fscHOdCSPES DA WASH DC 

ACSF0R DA ATTN CHF TNG DlVWASH DC 

CG USA yfiT COMS ATTN AMCPP-TE 

CNF OF FnGNRS DA ATTN ENGTE-T 

HQ A^MY MAT COMO R+0 DRCTE ATTN AMCMQ-RC 

US ARMY BEHAVIOR £ SYS PSCH LAB ATTNCRD-AR AR L VA 

0*0 P£ * S MGT OFV OFC ATTN MQS SRC INEW EQUIP) OPOMH 

P°OVDST MARSHAL GSN DA 

DIR CIVIL AFFAIRS DF-CTE ODCSOPS 

QFC R£ SRP VR CQMPON DA 

CG USA Fee AGCT'aPL HALL 5TA ATTN AC OF $ G! VA 

ADMIN ODC ATTNS T£A I HE A L Y ) CAMgRON STA AL EX# . VA# 2231A 

CO US ARMY MED RgS LAB FT KNOX 

CHF OF R+U 0 A ATTN CHF TECH * IN'DSTR LI Al SON OFC 

CO US^ C DC MJO SERV AGCY FT SAM HOUSTON 

CG ARMY MFQ p*.p qOMD ATTN MEDOH=SR 

USA «EHAVinR £ SYS PLCH LAB ATTN CRD- Af C ARL VA 

COMOT USA CRT SURVE I‘, SCH £ TNG CTF ATT ED AOV FT HUAGMUCA 

COMOT UFA CBT SURVEIL SCH £ TNG CTR ATTN 0*5 DOC C N»W EQUIP AR I Z 

TWG £ ni vfl DIV nnrcpgpj 

COMDT USA C6T SURVilL SCH £ TNG CTR ATTN 1ST CAT TNG BDE ARIZ 

CARlER MGT sp ATTN R GFTiaNNt CAMERON STA ALEX VA 

USA LIB Q I V“T AGO ATTN ASDIRS 

PRES A^my MAINT AQ FT KAOX 

CG CON AT C ATTN ATIT-RO-RC FT MQNRD0 

CG CONftFC ATTN LIB FT MONROE 

co army car OiViL comd milit police agy ft Gordon 

USA ARCTIC TEST CTR CHF INSTR f, TEST ME TH DIV SEATTLE 

CHF USA AD H^U FT BLISS 

CHF USA ASMQR HRIJ E T KNQX 

CHF USA AVN hPU e T RUCKER 

CHF USA INF HR tl FT 8ENNING 

CHF USA TNG rjR mru PQFS OF MONTEREY 

CG 4TH ARMORED DIV ATTN DCSOT APO NY 09326 

CO 3D ARMORED C A V BERT ft LEWIS 

CO 1 AT H ARMORFD CAV RFGT ATTN AVN OFCR 4PQ C9|A6 NY 

CO 1ST BN 63PD ARmqr jj T DIV ATTN S3 FT RILRY 

CO 1ST SN 6ATH A® MQR 3*0 INF DIV ATTN S3 APO NY Q9C31 

CD 2ND SN 6 9 TH ARMOR BtH INF DIV ATTN S3 APO NY 09C34 

CO COMPANY ft 3D BN 32D ARMOR 10 ARMORlD DIV APB NY 

CO 3RD BN 3 7 TH ARMOR 4TH APMQRED DIV ATTN S3 APO NY 09066 

CALIF NG 60 T H ARMORED OIV LOS ANGiLlS ATTN AC QF SG3 

59 T H CORD HQ DIV ARMY MG JACKSONVILLE FLA 

CG HQ ?7TH APMDREO DIV NY AIR NG SYRACUSE 

TEXAS NQ *9 TH ARMORFD CIV DALLAS 

CG ARMY ARMOR CTR FT KNQX ATTN S3 AIBKGT 

CG 3RD INF OIV ATTN ACOFS G3 APO NY 09036 

CG 7TH INF OIV ATT ACOFS G2 A *□ SAN FRAN 962Q7 

CG BTH INF DIV ATTN ACOFS G2 APO NY 09112 

CG 4TH INF DIV IMECHi 5 FT CARSON ATTN ACnpg G3 

OA HQS FT C AP SON £ HQS 6TH INF DIV IM = CH) ATT MAJ HARRIS 

CG B2N0 ABN INF OIV ATTN ACBFS G| Bt BRAGG 

CG xvnr ABN COPPS ATTN ACOFS G3 FT BTAGG 



1 CO 197TH IMP 8RGD PT BFNNINS AT TW S? 

1 CO 1ST RN (REINFI ATTN S3 PT MYFR 

7 CO 3RD 9 N 6 TH INP REGT ATTN APQ N¥ C9742 
1 CO 1 7 1 S T IMP SO£ ATTN S3 J?0 SEATTLE 9S731 
L CO 2ND BM 1.5TH IMF 3RD INF HIV ATTN 53 APO NY P- 
§ CG 1st INF OI V ATTN ACG^S G3 FT sj L EY 

A CO 1ST P\ l {NECHi 52NQ INF 199 TH |NF POE ATTN S3 APP SAN F R AN 96219 

I CO 4TH BN CNECH) 54t h INF ATTN S3 FT KNOX 

1 CO USA PART 1C QP USN TNG 0FVIC5 CT3 FLA 

2 C n N SOL PES G D 7 T H PSVOP OP APG 96243 SAN FRAN 

t DA OFC DP ASST CHF OF STAFF PQP COMN-ELCT ATTN CET5-6 WASH 

1 CG M I L IT 01 ST OF WASHINGTON! 

2 DA USA 4DV GP (ARNGU5) FALFIGH NC 
l USA RECRUITING CH^n HAMPTON VA 

I DIR ARMY LIB PENTAGON 

1 STRATEGIC PLANNING GP CORPS f)F EN1NR ARMY map 55&V 
I CNF OF HILIT HIST DA ATTN GEN PEF SR 
1 CO USA 1 of H SP E C FORCES GP FT DCVRN5 

1 CD 74TH ARTY GP ( ADI ATTN S3 RI 
L CG 31 S T ARTY EOF AD ATTN S3 ^A 

L CO 49TH ARTY G & AD ATTN S3 -T LAWTON 

2 HQ S 4TH BN 59TH iRT* P E GT ATTN S3 NORFOLK 
1 CO 28TH AR T ¥ GP AD AT^n S3 SSLFOfOQE 4F 9 

L HQ5 45TH ARTY 9DE AD ATTN S3 A^L HT S ILL 

i CG 1 Q1 ST ABN DIV IAIRMC^IlEI ATTN 4C0FS G3 A PQ FAN FRAN 96383 

L CG 1ST CAV ( 4 I RM HR I L F I ATTN ACC C 5 G3 APQ FAN FRAN a 63R3 

1 US ARMY GEN EQUIP ATTN TECH l I G e T LE= 

1 US AFMY TROPIC TEST CTP on DRA'jrs q^3 ATTN FEHAV SCIFN Cl 
1 CO USAFAAC ATTN S3 c T SILL 
l □ CG III COR® 5 f. FT HOOD ATTN f,9 SEC FT HOQQ 

3f» cn 1ST APMnREO 01V ATTN G3 SEC * T Mngg 

30 CC= 2D ARMOR 10 OIV ATTN 53 SEC PT MHOO 

P.5 CO 1 3 TH SU° T 9G0E ayTM S’ SFC P T HOOD 

l CG USA FA C £ FT FILL ATTN AKPSIGT-TNTN 

S CO III CORPS ARTY ATTN G3 SEC FT SILL 

15 f.O 1ST AIT BGnF JTTM 03 SEC FT PUSS 

B CO USA TCI 6 FT POLK ATTN AKPOODCnr 

1 RSCH .CONTRACTS £ GRANTS 99 ARO 
1 RFSD 430 0 E C CNF OF RCP NASH DC 

1 £HF OF R£0 DA ATTN SCI INFO BR RICH 5®T Q I V WASH OC 

1 CO HOF RN UlAFAC £ FT SILL ATTN S3 

4 GO HI CORPS ARTY ATTN Si FORT SILL 
1 CO USRAH ATTN 53 FT SILL 

L CG US 4 F AC F 5 ATTN AKP5IAG-4S FT SRL 
1 F fl C M PPC'F ns MIL ITftey f C I USA R?TC 
1 G INC US ATLANTI " PLT CODE 312 A U IN BASF NORFOLK 
1 CDF TNG COY MAN 1 '/ 'J5 PACIFIC *L T SAN DIEGO 

5 TECH LIP I’R RUE O p NAV Pf 9 S ARC ANN E Y 

3 DIR PEAS RF5 ofv 9UR ne NAV PFPf 

1 TECH LIE B'JR os SNIPS COP? ?jr L NAVY DEPT 
1 fN.GNP PSYChCL 9R DN& CODE 465 ATT N ASST HEAD WASH DC 
3 cn + Q 1 ^ Mflv TNG DEVICE C 6 ORLANOn ATTN TECH LIP 
1 CD FLT A NT I — A I N ^ARFA^e TN Q SAN 0I S ??0 

1 CO NUCLIS* WPNS TNG CTR RAC.I c rC i«S NAV AIR STfe SAN DIEGO 

2 CD FLT TNG CTe N A V SaSE NEwPOPT 

1 CO FLE F T TNG C TR US NAY ST A SAN JICGO 

1 CLIN P5 v CHCL OCNTAL HVOI^Nt LINI T ;J5 NAV AC AO ANNAPOLIS 

1 PRES NAV WAP COLL N p V.P n P T ATTN ,J 4H3'! Lf9 

2 CD £ DIP US ATLANTIC FLT ASW TAC t ICAL MOJPpCtf 

1 CO NUCLEAR WEAPONS TNG CT6 ATLANTIC MTV AlP CTA N pfj . e QLK 

? CO FLT S^NAF SCH KEY WEST 

1 C fl FLT A. NT I WAFFARE SCH SAN *5 ! “GO 

1 CHF OF NAVL RSCH PRRS £ TNG a « J CnpS APL VA 

1 CHP UF NAV HIS ATTN HEAD T D B 5YC, HflL ‘3P CODE 452 

1 0 1 H US AV RE- 5 LAB ATTN f'TOE f 1 Pit 

1 DIR NAVAL RgCH LAB ATTN L 13 CCO-l 2 Zi^ WASH DC 

I CHF OF NAV a IP TNG TNG dec n^pT NAV AM STfl pcNSACOlA 

1 CO MiD FLO RES' lab Camp L E J c ! JMF 

1 COP. NAV MSL CTR POINT VUGU CALM ATTN YICH lH CPDF JC22 

I DIR APR Of n ACE CREW EAljia L A9 NAV A|R ENGNJ CTR pa 

1 O IC NAV B S e S PES A C T V V SAN OlfcGn 

1 NAV Nf U & 0R5YCH I AT &LS UNIT EAN OIEGO 

2 NAVAL MSL CTO (CODE i PT M1IGU CALIF 

1 DIR PEPS RFS LAB NAV PFF 5 PPHOPA^ 51JP 3 DR T ACTIVITY WASH NAV YC 

1 NAV TMC. PSPS CTR NAV 51 A NAV YH ANNEX COOg ATTN L I B WASH 

2 CQMOT MAPINE CORPS h Q M A& I NF CORPS ATTN C TDf AO-IR 
1 hq marine COpps sttn ax 

1 0 1 R MAP INF CORPS E dUC CTP MAP INF CORPS SCH OUANTICD 

1 DIR MAPINF CORPS INST ATTN FVAL UNIT 
1 IJS MARINF CORPS H05 HIST REF LIB ATTN MRS JAQHT 
1 CHF OF NAV OPNS QP-CIPI 
1 CHF QF NAVL OPS OP w 3 7 WASH DC 

1 CHF rp Nay OPNS nP=L!?TL 

2 COMOT HQS 6TH NAV 01 ST ATTN EOUC ADV NEW ORLEANS 
1 CHF OF NAV AIR TeCH t^'G NAV Al= S^A MSMPH15 

1 DIR OPS FVAL SR® OFF OF CHF HP NAV OPS 0PO3EG 

2 C n MOT PTP COAST GUARD HQ 

1 CHF QFCh pfr< 5 RfS + BfVlFW ?R COAST GUARO hq 
l CO US COAST GUAR IJ TNG CTR GOVERNORS ISLAND NY 

L CH IJS COAST GUARD TNG CTR CAPE ’AAV NJ 

1 CO US CP 4 ST GUARD TNG CTR £ SU e CTP, AlAMEOA CALIF 

L CP US COAST GUARD INST OK LA. rjTV -TKL A 

1 cn US COAST GUARD 6FS TNG CTP VOPWTDWN VA 

1 SUPT US COAST GUARD ACAD NfcW LONnoN C 3NN 
L OPNS ANL5 OFC HQ STRATEGIC. AIR CCMD OFFUTT AFB 
1 AIR TNG C OMn Ax PT RANDOLPH AFB 

L TECH DIR TECH TNG 0! VtHPDI LOWHY AFB COLO 

i CHF SCI niv CH C T F SCI + TECH DCS R +0 HQ AIR FQRf,t AFRSTA 

1 CHF OF PEWS RES DRCT* QF CIVILIAN PE«S OCS-PFR& HQ AIR. 

L CHF ANAL DIV I AF PD PL (RI DIR n6 OiPXQNNlL PLANNING Hn S USAF 

2 COP ELF.C SYS DIV LG H3NSC0M FLO ATTN ESMOA/STOP 36 MASS 
1 AFHRL/TT ATTN CAPT W S S EL L M A N LOWRY A p 9 

1 HQ SAMS? fSMSIPJ flP UNIT POST DF C LA APS CALIF 
| MlLIT TNG CTP OP? LAC XL AND AP® 

2 AFHRL f HR T ) Wft I RHT=F A T Tfi 9 SON AM 



O 




1 AM Q 4M3H 3P-OOKS AFB TFXAS 

1 HQ S ATC OCS/TErH TNG C AT T MS i RANDOLPH AFS 
1 DIP Aif* IJ LIB MAXWELL AFB ATTN AUL3T-33»2G3 
1 US A FA DI9 OF TH* LIP USA F ACAD COLO 

1 65 70 TH P&BS RSS LAB PSA = 4 AfSOSPAGS MED DIV LACKLAND AC3 
i TECH TNG CTR I LMTG t O p & I-L l J LOWRY AFB 
? ' HUMAN RESOURCES LAP BROOKS AF B 

1 COM3 T USAF SPEC OP SCH ( TAC ) EGLIN AFB 
1 AFHRL (FT) WILLIAMS AFP ARIZ 
1 P5YCH0BtnL0C v °FmG NATL SCI FOUND 
1 DTR NATL S6CUF ACY FT GEO G MpAOi ATTN TQL 

1 DIP NATL SFCUP AGV FT 510 G MFADE ATTN DIR OF TNG 

3 C 1 4 ATTN CPS/A5Q STANDARD DI5T 

1 SYS FVAL DIV P-S DIRFCTCRATE nGn-OCD PGNtAGUM 
1 DF P T OF STATS bur of INTFL + P£S ExT c RNAL RiS STAFF 

1 SCI INF^ EKCH WASHINGTON 

2 CHF MGT £ GEN TNG PIV TH 2CQ FAA WASH DC 

1 EUP OF P?S £ ?NG3 IJS POST C^C DF R T ATTN CHF HUMAN FACTORS BP 

1 6 DUC MgniA BR OF ATTN T D CL5MFNS 

1 NAT«L PUR STANDS BEHAV SCI Ge ATTN DR D E EfiLlCK 
1 one DF IMTERNATL TNG PLANNING £ FVAL 4R AIO WASH DC 
I DEPT OF TP A NS FAS ACQ SEC HQ 6 IF, A WASH DC 
? fcB IC OF WASH DC 

1 CUNS01 TED LAW GNFQRCEMENT TNG CT» WASH DC 

1 SYS DE V p L CORP SANTA MQNICA ATTN LI3 

2 DUNLAP ± ASSOC INC DARIEN ATTN LIB 
2 RAC ATTN LIB MC L F AN VA 

1 R AND CO E P WADHINGTOU AtTN Lie 

7. EL^CT P?PS RSCH GP U QF SOUTHERN CALIF 

1 COLUMBIA U ELEC Tg 5 LABS ATTN TFCH EDITOR 

1 MITRE COP.P BEDFORD ^ASS AT TN LfB 

2 SIMULATION ENG R CORP ATfN DIR n E ENGR FAIRFAX VA 
2 LEARNING R £0 CTR U fl e PITTS ATTN DlR 

1 HUMAN SCI PE5 INC MCLEAN VA 

2 TECH INFO CTR ENGNF DATA SERV N AMER AVN INC COLUMBUS O 
1 CHRYSLSf COn® MSL DIV OCTROI T ATTN TECH INFO CTR 

1 RAYTHEON 5 EP V CD ATTN L IBN BURLINGTON MASS 
l GEN DYNAMICS PQMONA DIV aTTN LIB DIV CALIF 
1 OTIS ELEVST03 C n O I V ATTN LIB 5 T A MS TP 0 CONN 

1 MGR P I n Tf CHNOL (3G y AERHEPACc Svs OlV MS 6H-25 BOEING CO SEATTLE 
1 ins RICH f. ENG SUPT DIV ARL VA 
1 SCI £ TECH 01 V IDA ARL VA 

1 HUGHis AIRCRAFT COMPANY CULVER CITY CALIF 
1 DIR CTR FOR RF 5 n N LEARNING *■ TFACHlNG U OF MICH 
1 501 TOR TNG y E5 a«ST5- AM FR SQC P p TNG DIRS U OF TFNN 

1 DIR CTP FOR >TSGH IN SOCIAL SYS KENSINGTON MD 

3 CANADIAN JOINT S T 4F e OFC OF DEF RlS MSMBER WASHINGTON 

3 Canadian army sta^r Washington attn gsu2 tng 

2 ROYAL SWlOi SH k MS SV ATTN ARMY ATTACHE 

2 AUSTRALIAN NAV A'TACHF FM&SV DF AUSTRALIA WASH DC 

1 OFC OF A I P ATTACHE AUSTRALIAN f.MfSY ATTN: T.i, NAVGN WASH, D.C 

2 Qft B T DODO 'J OF SHE*FFIFLD Dt p T OF PSYCHOL EHQ 
l M E NN i NGE r FOUNDATION TOP E KA 

I AMER INSTS C QR RSCH SILVER SPRING 
1 AMER INSTS fhr rsCH Attn L I 3N PA 
L DIP PR I M AT E LAB UN I V OF WlS PAD I f ON 

3 MATRIX £fCM CO FALLS r^u ,B C M VA 
1 E-QUC C TNG C3NSLT CO LA CAL I f 

l 0 s GEORGE T MAUTV CHKN CFPT re SSYCHDL U OF OFL 
1 YITPQ LABS SILVjT S DB lNG MD attn LI BN 
j H e AD DEPT OF ORYCHOL UNI V OF SC CC1LUM3IA 
1 TVS PFpf STAFF nc C3 KNOXVILLE TfcNN 
l U C p GEORGIA L’iPT HF OSYCHOL 
1 GE C n WA r ^ 0 C 

1 Ampp INST RSCH ATTN UB PALO ALTD CALIF 

1 C n LL CP ARTS £ SC! ij re MIAMI ATTN L L MCCUlTTY 
1 ROWLAND * CO HADOONFfFLf 1 NJ ATTN PRES 
1 OHiC STATF ij SCH OF dVN 

1 SCI PSCH ASSOC INC DIR CF FVAL CHICAGO ILL 
1 AIRCRAFT AkMANcNTS INC mCKFYSVlLLE MP 

1 OR J £ CULLEN JF°T OF 50 C f. ANTHROP UMlV Op R[ 

2 QF r GON f T A‘ r c U Hr^r pc v-UlT SCI ATTN AD j 
1 TUFTS U HUMAN SNCNF INFC * 4NL S PROJ 

1 AMS-T PSYCHOL ASSOC wASHINGTHN ATTN 5 S YCH3L ABSTR 
1 NO ILL U he ad OfcPT OR p|yChQl 
I GEORGIA INST TF TECH ri & SCH SF PSYCH1L 

1 ENGNR LI® FAIRCHILD HILLER REPUBLIC AVN DIV ^ARMINGDALE N Y 
1 LIFE SCI INC PT WFIR T H ATTN PRES 
i AMPR 35HAV SCI CALIF 
1 COLL CF w v A MARY fCH OF ECUC 

1 SD ILLINOIS U 9E n T OF PSvCHn L 

2 ASSOC DIR COC TNG D&OS ATLANTA P A 

1 WASH Mi u iv> aa v SYS TSCH LI9 DIV 3ETH5S0A MD 

1 NFFTHWc 5T E F N U DEPT TF INDSTR ENGNR 

1 D R L T Vj V p 0 5 D MY STATE r CMC 05 ft T ABSTRACT EDI TOP AVCB 
1 AEROSPACE SAFETY DjV U >F SGUTHEPN CALIF LA 
1 MR BRANPnN 6 SMITH RgS aSSQC U n= MINN 

| OR V 7. AC HE® T PT 1 GOOD HOPE GA 

1 J p LYOOn 0 1 R JR ROT C S AN ANTONIO TfXAS 

1 0*5 g enyuKE DERT OF PSYCH iJMIV O p LQUISVILLF 

2 CHRYSLFF CORO OE F PNGS AT T n DR H BERMAN DETRCIT 

1 DR S RGSCDE ASSOC DlR FOR RSCH INST OF AVN U Or ILL 

1 OR c H F 1 M OEPT EDUC PSYCh CITY U OF NY 

1 DP £ PC F K 1 NS PROF OF PSVCm ST CLOUD STATE CGlL M I NN 

1 MS S AILUS A 5 5QC OF AMLS PR WASH DC 

1 DP W PE VAN AMF§ ASSOC =CR ADVMN T OF SCI WASH DC 

1 DP W C RIPL U G e SOUTMtPN CALIF LA 

1 DR C W R«av 424 CUnCUe LI NY 

l MR J M CHF. IfT IF RkfiS RIGGS NATL BANK WASH DC 

1 UP C W CLARK V3 CDF RSCH RSCH TRIANGLE INST NC 

1 5FN H P HARRIS I USA RETIRES THE CITADEL SC 

1 DP L T RACEB l?Cn POXWOOD C IF WAYNESSDRD VA 

1 DP M SHOE MAX g R Ole TNG RSCH GP NY 

i ac f U rth southn panpic Cr San fran 

1 =u OF MINN DEPT OF INDUST |pUC ATTN R E KUHl 

(Arl 



1 VOOTECH iOUC PROG PLNNG olv ATTN 4 STOCK ST P&UL 
1 CHF PROCESSING DJV DUKE U LIB 
I U 0^ CALIF GEN LIB DOCU DEPT 
L FLOfilOP S T AT! U L IB GIFTS * EXCH 
l PSYCHOL LIB HARVARD UN IV CAMBRlOGS 

1 U (IF ILL LIB SEP DEPT 

2 U DF KANSAS LIR PERIODICAL OEPT 
i u NfibPaSKa LIBS AC 9 OEPT 

L OHIO STATE U LIBS GIFT + EXCH pf V 
1 PINNA -ST A f F U PATTiE L 1 8 DOCU DESK 
1 PUROUF U LIBS p?R 1 00 1 CALS CHECKING FILES 
l STANFORD U LI^S COCU L.I B 
1 LIRN U hp T5*AS 
I SYRACUSE U LIS SEP PIV 

i serials sec un i y of m inn Minneapolis 

I STATS U CF IPwA U B S SFR 6CQ 
I NO CAROLINA STATS CPLL EH HILL L IB 



2 BOSTON U Li BS ACC Pi V 
1 U OF MICH LIBS SER HIV 
1 BP OWN U LIB 
1 COLUMBIA U LIBS ft-OCU ACS 

1 DIR JOINT u LI%S NASHVILLM 

2 LIB GEO WASH UN i V ATTK SP^C COLL DEPT WASH DC 

a Lie OF congress r.HF os ixcN * gift niv 

I U OF PGH DOCU LTRN 

1 CATHOLIC U LIP EOUC C PSYCHQL LIB WASH DC 
1 U OF KY HAP GAR FT I KING LIB 
1 SO ILL U ATTN L I PN SER DIPT 
1 KANSAS STATE U FARRELL LIS 
I BRIGHAM YOUNG U LIR SIR SECT 
1 U OF L CMJ I S V I LL T L T 9 BELKNAP CAMPUS 
1 GEORGE TOWN U LIM SEP. DE °T WASH DC 

1 L r ? S COLn Statf u attn fine, lion ft Collins 
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